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Abstract 

Basin-Hopping (BH) or Monte-Carlo Minimization (MCM) is so far the most reliable 
algorithms in chemical physics to search for the lowest-energy structure of atomic 
clusters and macromolecular systems. BH transforms the complex energy landscape 
into a collection of basins, and explores them by hopping, which is achieved by 
random Monte Carlo moves and acceptance/rejection using the Metropolis criterion. 
In this report, we introduce the jumping process in addition to the hopping process 
in BH. Jumping are invoked when the hopping stagnates by reaching the local 
optima, and are achieved using the Monte Carlo move at the temperature T = oo 
without rejection. Our Basin-Hopping with Occasional Jumping (BHOJ) algorithm 
is applied to the Lennard-Jones clusters of several notoriously difficult sizes. It 
was found that the probability of locating the true global optima using BHOJ is 
significantly higher than the original BH. 
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1 Introduction 



The Monte Carlo method based on the Metropolis algorithm is the most suc- 
cessful and influential stochastic algorithm of the 20th century and has been 
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used in variety of applications not limited to physics [1]. The method is pow- 
erful in an exhaustive search of highly multi-dimensional phase space, and, 
hence, has been routinely used to calculate the thermal averaging of statisti- 
cal physics. 

Aside from the applications to statistical physics, the Metropolis algorithm 
has been used as a vehicle for global optimization, that is, a task to search 
for the lowest minimum point in a rugged landscapes in a high dimension. In 
fact, the simulated annealing (SA) [2] based on the Metropolis algorithm is 
the oldest metaheuristics in global optimization. 

In global optimization, a good balance between a global search (exploration) 
and a local search (exploitation) is necessary. Since the Metropolis algorithm 
has only the ability to perform a global search, it is usually necessary to aug- 
ment SA using a more traditional local optimization method to handle realistic 
problems [3]. Later, a method which combines the Metropolis algorithm and 
the gradient-based local search algorithm was proposed. That is the Monte 
Carlo minimization (MCM) of Li and Sherga [4], and the basin-hopping (BH) 
of Wales and Doye [5]. Wales and Doye [5], for example, used their BH al- 
gorithm to study the lowest-energy structures of Lennard- Jones clusters that 
consist of up to 110 atoms successfully. 

In this paper, we propose a new variant of the Basin-Hopping(BH) algorithm. 
In contrast to another variant of the BH by Leary and Doye [6,7] where only the 
down-hill search is allowed, we borrow the concept of extremal optimization [8] 
or thermal cycling [9], and introduce the process of jumping to enhance the 
search of a rugged energy landscape. 



2 Jumping in Basin Hopping 

The Basin Hopping (BH) algorithm (which is also called the Monte Carlo 
plus minimization, MCM) uses hopping due to Monte Carlo random walks to 
explore the phase space, and gradient-based local optimization to locate the 
local minimum or basin plus Metropolis criterion to accept or reject the move. 

Since the energy landscape explored by the usual Monte Carlo move and 
immediate relaxation to a nearby basin of attractor using the gradient method 
in BH looks like hopping among basin of attractors, the algorithm is termed 
" Basin Hopping" . In order to enhance the exploration, the Monte Carlo move 
in BH consists of a simultaneous displacement of all particles in the cluster in 
contrast to the usual Monte Carlo method in classical statistical mechanics [10] 
where usually a randomly chosen single particle is displaced. 
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Fig. 1. The exploration of the energy landscape using the BH algorithm. The uphill 
moves, which uses the usual Monte Carlo move may not be possible. 

The BH has been extensively tested [5] for the simplest benchmark problem 
for the Lennard Jones clusters LJ„ [3,11,12,13,14] where the total energy of 
n-atom cluster is given by 



where r^- is the distance between two particles i and j within the cluster. 
Even for this simple Lennard- Jones problem, the BH clarified the extremely 
complex energy landscape for several clusters [15], and it even failed to locate 
the lowest-energy structures for several special sizes. 

For example, the BH could not locate the lowest minimum of LJ 75 _ 77 , LJ 98 , 
and LJ102-104 easily [5] when an unbiased search that starts from a completely 
random initial configuration of clusters is used. In fact, in order to find out the 
lowest-energy structure of LJ 76 , Wales and Doye [5] had to use seeding to feed 
the BH the lowest-energy structure of smaller LJ 75 or larger LJ 77 clusters. The 
unbiased search has an extremely low probability (4%) of hitting the lowest- 
energy structure even when large numbers (100 times) of a fairly long run 
(5000 step) were executed. The same problem occurred for LJ102-104, and less 
severely in LJ 69 , LJ 78 and LJ 107 . 

Difficulty occurs when the energy landscape consists of several large valleys 
(funnels) instead of one, and the funnel corresponding to the lowest-energy 
minimum is narrow and separated from other funnels by a high barrier [15]. 
The Monte Carlo trial move plus local minimization and acceptance/rejection 
using the Metropolis criterion is less powerful and time-consuming to overcome 
such a large barrier (Fig. 1). 

Recently, a new variant of the basin-hopping algorithm called the "Mono- 
tonic Sequence Basin-Hopping algorithm" (MSBH) was proposed by Leary and 
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Fig. 2. The flow-chart of the basin-hopping with occasional jumping (BHOJ) algo- 
rithm. 



Doye [6,7]. Their algorithm is essentially the BH at temperature T = 0, which 
allows only downhill moves. When the search is stacked at a local minimum, 
the program restarts from a new random configuration. Therefore, MSBH [6,7] 
is essentially the multi-start strategy of a greedy search. Naturally, the MSBH 
algorithm seems less powerful [7] than the original BH algorithm because it is 
not equipped with any mechanism to cross the barrier. 

One of the present authors [16] suggested another extension of the BH by in- 
troducing the concept of "extremal optimization" (EO) proposed by Boettcher 
and Percus [8] . In this EO-based basin-hopping (EOBH) algorithm, the Monte 
Carlo move of only one less-bounded particle within the cluster is attempted, 
and every move is accepted without using the Metropolis criterion. Therefore 
this EOBH is essentially the BH at T = oo. Although the EOBH can achieve 
the crossing of high barriers in contrast to the MSBH, it is again less powerful 
than the original BH because its ability in terms of a local search is less effec- 
tive though the method is proven to be useful to enumerate all the low-energy 
structures [16]. 

The lesson learned from these two previous exercises is that the inclusion of 
the high-temperature Monte Carlo move at T = oo will enhance the ability 
of a global search (exploration), but the original Metropolis criterion of the 
Monte Carlo move should be retained to maintain the efficiency of a local 
search (exploitation). Actually, such a prescription of re-heating or thermal 
treatment at high temperatures has been repeatedly proposed in the appli- 
cation of the simulated annealing (SA) [9,17]. For example, Mobius et al, 
introduced "Thermal Cycling" and Ingber [17] introduced "reannealing" in 
SA. In order to enhance the ability of crossing the high barrier in the BH, we 
have introduced a re-heating process called "jumping" as shown in Fig. 2. 
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Fig. 3. The exploration of the energy landscape (dotted line) using the BHOJ algo- 
rithm. There are two kinds of uphill moves: one is the hopping (thick solid arrows) 
between basins (thin solid line) which uses the usual Monte Carlo move followed 
by the local minimization and Metropolis acceptance, another is the jumping (thick 
chain arrow) using a simple Monte Carlo move without minimization and rejection. 



Jumping is the Monte Carlo move without relaxation (local minimization) 
at T = oo, and, hence, it is always accepted. When the usual Monte Carlo 
moves are rejected MAX times, the system is judged to be trapped at the local 
minimum. Then the temperature is raised to T = oo, and the Monte Carlo 
moves (jumpings) are executed JMP times in the search space to allow for 
the system to escape from the local minimum (Fig. 3). This move is always 
accepted irrespective of the increase in the energy because of T = oo and is 
called jumping here. The parameter MAX is used to detect the entrapment. 
The parameter JMP is used to try to climb up the barrier several times. If 
the JMP is too large, the algorithm is nothing more than simple random 
multi-start strategy. It is essential to keep the partial memory of the previous 
state [9]. So, the JMP should not be too large. We will call this version of BH 
the "Basin- Hopping with Occasional Jumping" (BHOJ). 

Now, the exploration of phase space in our BHOJ proceeds as follows (Fig. 
3): the rugged energy landscape is transformed into successive steps of the 
basin by local minimization. The downhill move is simply the descending of 
the stairs by hopping. There are, however, two kinds of uphill moves. One is by 
climbing the stairs by hopping using the Metropolis criterion, which is costly 
and may not be effective to climb up the high barrier because the moves with a 
large energy difference are rejected by the Metropolis criterion. Another move 
is jumping, which does not use local minimization and is always accepted, so 
the uphill moves by jumping do not use stairs and are simply along the surface 
of the hill (Fig. 3). This jumping must be an efficient way to escape from a 
local minimum (valley) and to explore the next basin of the valley when it is 
separated by high barriers. 
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Table 1 

Success rates of original BH [5], MSBH [7], PFA [20] and our BHOJ for selected 
Lennard-Jones clusters which are notoriously difficult cases to find out the lowest- 
energy structure. In MSBH Leary conducted experiments 1000 times while we con- 
ducted experiments 100 times for original BH and BHOJ. 



Cluster 


Energy 


BH 


MSBH 


PFA 


BHOJ (JMP) 


LJ38 


-173.928427 


87/100 


124/1000 


39/100 


96/100 


(7) 


LJ75 


-397.492331 


1/100 


4/1000 


2/200 


5/100 


(3) 


LJ 76 


-402.894866 


5/100 


8/1000 


2/50 


10/100 


(5) 


LJ77 


-409.083517 


6/100 




1/50 


5/100 


(7) 


LJ98 


-543.665361 


10/100 


6/1000 


4/100 


10/100 


(3) 


LJ102 


-569.363652 


3/100 


31/1000 


9/100 


16/100 


(3) 


LJ103 


-575.766131 


3/100 




3/30 


13/100 


(5) 


LJ104 


-582.086642 


3/100 




2/30 


12/100 


(3) 



3 Experiments 

In order to test the performance of our modification of the BH with occa- 
sional jumping (BHOJ), we have calculated the lowest-energy structure of the 
Lennard-Jones clusters of a particular size, LJ 38 , LJ 75 - 77 , LJ 98 , and LJ 102- 104 
for which the original BH is not effective. We conducted a 100 independent 
unbiased search starting from 100 random initial structures with the maxi- 
mum of 5000 iterations which do not include the jumping process. We also 
performed the same experiment using the original BH [18] with the same ran- 
dom initial structures. The temperature is fixed at T — 0.8. Two additional 
parameters MAX and JMP for the BHOJ are arbitrarily fixed to MAX=10 
and JMP=3 or 5 or 7. 

Table 1 gives the success rates of 100 unbiased searches. Our BHOJ could 
successfully reproduce the lowest-energy structures in the literature [5,19]. 
It is apparent that our BHOJ performs in general better than the original 
BH. The success rate increased twice to five times from the original BH to the 
BHOJ. Thus, the ability of exploration is in fact enhanced by the introduction 
of jumping processes. For the sake of comparison, we also showed the results 
of MSBH of Leary [7] and the parallel fast annealing (PFA) of Cai et at. [20]. 

Figure 4 shows the trajectory of a successful run for LJ 10 2 when using the 
BHOJ. Jumping occurs only 9 times during the run of to 2500 steps. How- 
ever, this jumping may induce the uphill moves which assist in the exploration 
of the next valley separated from the previous valley by a high barrier, and our 
BHOJ can successfully find out the lowest-energy structure at approximately 
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1400 steps. 




j i i i i i i_ 
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Fig. 4. An example of the trajectory of the successive run of BHOJ for LJio2- 
Arrows indicate the positions where the jumping occurs. 

In comparison to the various sophisticated methods [21,22,23,24,25], our basin- 
hopping with occasional jumping (BHOJ) is intuitively appealing and simple 
to implement. The performance of the algorithm seems better than most of 
the above algorithms. 

Finally, in order to further test the performance of our BHOJ, we have used 
the BHOJ to search for the lowest-energy structure of larger clusters even 
larger than LJi 48 [26,27]. 

Table 2 

Success rates of original BH [5] and our BHOJ for selected larger Lennard-Jones 
clusters. 



Cluster 


Energy 


BH 


BHOJ (JMP) 


LJ107 


-602.007110 


12/100 


19/100 (7) 


LJl85 


-1125.493794 


0/500 


1/500 (5) 


LJl86 


-1132.669966 


1/200 


2/200 (3) 


LJl87 


-1139.455696 


0/200 


2/200 (3) 



Table 2 shows the results for LJ107 and LJi 8 5_i 87 . For LJ107 we could confirm 
the new lowest-energy structure found by Wales and Doye [5] using our BHOJ. 
We could also successfully confirm the lowest energy -1125.493794 cited in [27] 
found by Leary for LJ 185 which is lower than the previous record -1125.304876 
found by Hartke [23,27]. The new lowest-energies -1132.669966 for LJ 186 and 
-1139.455696 for LJ 187 found by Hartke [23,27] were also successfully located 
by our BHOJ though the success rates of these three cases were very low. 
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4 Conclusion 



In this paper we proposed a way to improve the performance of the basin 
hopping (BH) algorithm by introducing the jumping in addition to the hop- 
ping. We call this new algorithm as the basin-hopping with occasional jumping 
(BHOJ). The jumping is a process of heating the system and raising the tem- 
perature to infinitely high which is attempted when the trajectory in the phase 
space is trapped at a local minimum. By jumping, the trajectory can climb 
up high barriers and can explore the next valley. Thus the exploratory ability 
of the algorithm is enhanced. 

Experiments on benchmark problem of the Lennard- Jones clusters, in partic- 
ular, for notorious difficult sizes of 75 to 77 particles LJ 75 - 77 , of 98 particles 
LJ 98 , and of 102 to 104 particles LJ 102 _i 4 reveal that the proposed BHOJ is 
really superior to the original BH. 

This jumping is easy to implement, and consumes very little CPU resources. 
Any adaptive or scheduled jumping could be easily incorporated. The BHOJ 
with jumping will be helpful to search for the lowest-energy structures of larger 
clusters and more complex clusters with many body forces. 
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